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DETAILED ACTION 
Allowable Subject Matter 

1. Claims 29-30 are objected to as being dependent upon a rejected base claim, but would be 
allowable if rewritten in independent form including all of the limitations of the base claim and 
any intervening claims. No prior art anticipates or suggests a method of processing data in time- 
series, comprising generating a data list comprising position coordinates of said object and flags 
indicating a state of said object at a plurality of points in time, wherein said position coordinates 
of said data list are analyzed to determine speed of said object (claim 29). Claim 30 is allowable 
because it depends on claim 29. 

Claim Rejections - 35 USC §102 

2. The following is a quotation of 35 U.S.C. 102(e) which forms the basis for all novelty- 
related rejections set forth in this Office action: 

A person shall be entitled to a patent unless — 

(e) the invention was described in a patent granted on an application for patent by another filed in the United States 
before the invention thereof by the applicant for patent, or on an international application by another who has 
fulfilled the requirements of paragraphs (1), (2), and (4) of section 371(c) of this title before the invention 
thereof by applicant for patent. 

3. Claims 1-4 and 15-18 are rejected under 35 U.S.C. 102(e) as being anticipated by Jain et 
al. ("Jain," U.S. Pat. No. 5,729,471). 

4. Jain, in disclosing a view selector, also discloses, with respect to claim 1, a time-series 
data processing device, comprising: 

image-pick up means for picking up a specific object (cameras 10a, 10b, etc., FIG.l); 
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data processing means for generating a data list indicating, in time series, a temporal transition of 
a position and a state of said object picked up by said image-pick up means, with respect to a 
time (environmental model builder 12, FIG.l); 

animating means for animating said transition of said position and said state of said object in 
accordance with said data list (viewer 14, FIG.l); and 

display means for displaying at least one of said data list generated by said data processing means 
and said image animated by said animating means (display 18, FIG.l). 

5. Concerning claims 2 and 16, Jain discloses said data processing means configured to 
display synchronously on said display means each corresponding image by linking an image of 
said object, which is picked up by said image-pick up means, in accordance with said data list 
generated, when said display means display said image of said object animated by animating 
means (col.16, 11.34-41). 

6. Regarding claims 3 and 17, Jain discloses said data processing means configured to 
perform at least one kind of data analysis, by linking an image animated by said animating 
means, in accordance with said data list generated (col. 18, 11.24-33, especially 11.29-33: data 
processing means selects "best" camera view). 

7. Regarding claims 4 and 18, Jain discloses said specific object comprising a tool used by 
players in a sports game (football; col. 14, 11.29-36). 



Serial Number: 09/919,989 
Art Unit: 2671 



Page 4 



8. Claim 15 is essentially the same as claim 1 except claim 1 is an apparatus claim and 
claim 15 is a method claim. However, Jain also anticipates claim 15 because it is inherent that 
an apparatus facilitates the implementation of a method. 

9. Accordingly, in view of the foregoing, claims 1-4 and 15-18 are rejected as being 
anticipated under 35 U.S.C. 102(e) by Jain. 

10. Claims 6-7, 20-24, 36 and 38-39 are rejected under 35 U.S.C. 102(e) as being anticipated 
by Katayama (U.S. Pat. No. 5,769,713). 

1 1 . Katayama, in disclosing a data processing apparatus for a baseball game, also discloses, 
with respect to claim 6, 

• data processing means for generating an image data by image-picking up an image of a 
sports game (through a video camera; col. 6, 11.1-3), for processing said image data 
generated in accordance with a predetermined format (video, col.6, 11.1-3); and for storing 
said data processed in said predetermined format (videocassette; col.6, 11.1-3); 

• interface means connected to said data processing means comprising an instruction 
entering means for entering a plurality of instructions (menu screen I, FIG.3, and menu 
screen H, FIG. 11), 

said interface means inputs said processed data in said predetermined format, converts 
said input data into a predetermined form in accordance with an entered instruction, 
(statistics; see, for example, col.6, 11.12-20), 

• and outputs said converted data in accordance with said entered instruction; 
(FIG. 16 — the output of clicking on the score table L icon in FIG.l 1) 

• and image displaying means connected to said interface means for displaying on a screen 
said outputted data from said interface means (monitor display A, FIG.l) 
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• wherein said interface means is operable to convert said inputted data into each of a chart, 
a numerical list (the object labeled "batting order" in FIG.22 is both a chart and a 
numerical list, and the chart/list is produced by the instruction which executes when the R 
key is pressed (see col.8, 11.29-31)), an image (produced by the instruction which executes 
when the user clicks on M and L; col.6, 11.40-44) and a video (the instruction that 
produces, for example, FIG. 12; see also col.4, 11.50-53). 

12. Concerning claims 7 and 21, Katayama discloses said interface means configured to 
enable said image displaying means to display a play list or a graph that is indicative of a desired 
analytical result in response to a kind of said instruction (FIG.22, which concerns meetings 
between a certain batter and a certain pitcher). 

13. Claim 20 is essentially the same as claim 6 except that claim 6 is an apparatus claim and 
claim 20 is a method claim. However, claim 20 is also rejected because it is at least obvious that 
an apparatus facilitates the implementation of a method. 

14. Regarding claim 22, Katayama discloses all claim limitations through "displaying said 
converted data" (see claim 6), and also these limitations: 

wherein said step of converting said data processed in said predetermined format (video; col.6, 
11.-3) into said predetermined form in accordance with said instruction (statistics; e.g., col.6, 
11.12-20) comprises entering at least one related item with respect to a sports game subject to an 
analysis, which is utilized commonly in said plurality of different kinds of analyses by entering a 
common instruction (selecting a player from the score table in order to view pitching form of 
opposing pitcher; col.6, 11.40-49). 
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15. With respect to claim 23, Katayama discloses said related item including at least one of a 
player, a team, weather, a stadium of a game, a date of a game, a starting time of a game, and a 
number of spectators of a game (player; col.6, 11.40-49). 

16. Concerning claim 24, Katayama discloses said step of converting said data processed in 
said predetermined format into said predetermined form in accordance with said instruction 
comprises selecting an analysis of data or an analysis of formation regarding a sports game 
subject to an analysis by main instruction entering (analysis of pitching form of opposing pitcher; 
col.6, 11.40-49). 

17. Regarding claim 36, Katayama discloses said interface means further comprising a 
function of linking one analysis to other analysis in accordance with said play list (meetings 
between opposing pitcher and batter are the subject of analyses in at least FIG.22 (col.8, 11.29- 
33), FIG.21 (col.8, 11.13-15), and FIG. 19 (col.7, 11.56-61)). 

18. With respect to claim 38, Katayama discloses 

• generating image data by imaging a sports game (through a video camera; col.6, 11.1-3), 
for processing said generated image data in accordance with a predetermined format 
(video, col.6, 11.1-3); storing said data processed in said predetermined format 
(videocassette; col.6, 11.1-3); 

• entering a plurality of instructions (menu screen I, FIG.3, and menu screen II, FIG. 1 1), 
converting said processed data into a predetermined form in accordance with said entered 
instructions (statistics; see, for example, col.6, 11.12-20); 

• displaying said converted data (FIG. 16 — the output of clicking on the score table L icon 
in FIG. 11); 
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• displaying a play list or a graph that is indicative of a desired analytical result in response 
to a kind of said instruction (FIG.22, which concerns meetings between a certain batter 
and a certain pitcher); 

• displaying all plays of an opponent teams at said sports game as a list in accordance with 
said play list, retrieving a desirable play seen at said sports game by designating an 
optional item of said play list (FIG. 16 displays all plays, and col.6, 11.24-48 explains how 
a desirable play is retrieved). 

• wherein said predetermined form comprises at least one of a chart, a numerical list (the 
object labeled "batting order" in FIG.22 is both a chart and a numerical list, and the 
chart/list is produced by the instruction which executes when the R key is pressed (see 
col.8, 11.29-31)), an image (produced by the instruction which executes when the user 
clicks on M and L; col.6, 11.40-44) and a video (the instruction that produces, for 
example, FIG. 12; see also col.4, 11.50-53). 

19. Concerning claim 39, Katayama discloses linking one analysis to other analysis in 
accordance with said play list (meetings between opposing pitcher and batter are the subject of 
analyses in at least FIG.22 (col.8, 11.29-33), FIG.21 (col.8, 11.13-15), and FIG. 19 (col.7, 1156-61)). 

20. Accordingly, in view of the foregoing, claims 6-7, 20-24, 36 and 38-39 are rejected as 
being anticipated under 35 U.S.C. 102(e) by Katayama. 

Claim Rejections - 35 USC §103 

21 . The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth 
in section 102 of this title, if the differences between the subject matter sought to be patented and the 
prior art are such that the subject matter as a whole would have been obvious at the time the invention 
was made to a person having ordinary skill in the art to which said subject matter pertains. 
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Patentability shall not be negatived by the manner in which the invention was made. 

22. Claims 5, 19, 28 and 31-33 are rejected under 35 U.S.C. 103(a) as being unpatentable by 

Jain. 

23. With respect to claims 5 and 19, Jain does not specifically disclose said sports game as 
soccer, and said tool as a soccer ball. However, there is no appreciable distinction between 
soccer and football with respect to this invention. Football was only an example of many 
possible sports applications to which the Jain invention can apply. This invention can be applied 
to any sport that is highly structured from both a database and computer vision perspective (see 
col. 18, 1.66 to col. 19, 1.3). Both soccer and football feature, for example, hash marks to indicate 
a set distance from the side border, or sidelines, of the field (col.22, 11.18-19). Therefore, it 
would have been obvious for Jain to have disclosed soccer and a soccer ball in addition to the 
game of football and a football. 

24. Regarding claim 28, Jain discloses a method of processing data in time-series comprising 
imaging a specific object (col. 16, 11.17 and 32-34); 

generating a data list, said data list comprising position coordinates of said object and flags 
indicating a state of said object at a plurality of points in time 

(col.22, 11.27-37 produces a data list comprising position coordinates of said object at one point 
in time; however, it is obvious that inquiring as to the position coordinates of objects at another 
point in time (for example, by capturing the image at another time) will produce "flags indicating 
a state of said object at a plurality of points in time"); 

analyzing said data list based on instruction from a user to determine desired output 

(in col.22, 1.62 to col.23, 1.56, analysis occurs of 2D locations of a player to determine 3D 

location. CoL21, 11.26-38 disclose that this occurs due to the use of a viewer's 3D cursor); 
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and displaying said desired output (col.21, 11.41-46). 

25. With respect to claim 3 1 , Jain discloses said object as a player and said state of said 
object comprises at least one of a play, pass, dribble and shoot (play — col.12, 1.65 to col.13, 1.5). 

26. Concerning claim 32, Jain discloses said object as a team and said state of said object 
comprises at least one of a team formation and ball possession (col.33, 11.14-20; a football player 
represents a team). 

27. Regarding claim 33, Jain discloses said desired output as comprising a numerical list 
having at least one numerical value for each flag indicating state of said object (col.22, 11.27-37). 

28. Accordingly, in view of the foregoing, claims 5, 19, 28 and 31-33 are rejected as being 
unpatentable under 35 U.S.C. 103(a) by Jain. 

29. Claims 8-1 1 and 35 are rejected under 35 U.S.C. 103(a) as being unpatentable by 
Katayama in view of Tamir et al. ("Tamir", U.S. Pat. No. 5,923,365). 

30. Regarding claim 8, Katayama discloses 

• data processing means for generating an image data by image-picking up an image of a 
sports game (through a video camera; col.6, 11.1-3), for processing said image data 
generated in accordance with a predetermined format (video, col.6, 11.1-3); and for storing 
said data processed in said predetermined format (videocassette; col.6, 11.1-3); 

• interface means connected to said data processing means comprising an instruction 
entering means for entering a plurality of instructions (menu screen I, FIG.3, and menu 
screen H, FIG. 11), 

said interface means inputs said processed data in said predetermined format, converts 
said input data into a predetermined form in accordance with an entered instruction, 
(statistics; see, for example, col.6, 11.12-20), 
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• and outputs said converted data in accordance with said entered instruction; 
(FIG. 16 — the output of clicking on the score table L icon in FIG.l 1) 

• and image displaying means connected to said interface means for displaying on a screen 
said outputted data from said interface means (monitor display A, FIG.l) 

• and an instruction entering means which comprises a main instruction entering level for 
performing a plurality of different kinds of analyses (menu screen n, FIG.l 1). 

3 1 . However, Katayama does not disclose a common instruction entering level to be utilized 
commonly for said plurality of different kinds of analyses. These elements are disclosed by the 
Tamir sports event video manipulating system (the use of light pen 60 to enter instructions to 
mark objects of interest on a video, col.7, 11.39-52). 

32. Therefore, it would have been obvious to one of ordinary skill in the art to have modified 
the Katayama apparatus in view of the Tamir system by installing the code that enables video 
editing in Tamir in the Katayama personal computer. Such a modification to Katayama would 
enable the user to utilize a fast editing and analysis tool for half-time situations to allow the 
coaches to make strategy adjustment during halftime (Tamir, col. 6, 11.18-20). 

33. With respect to claim 9, Katayama discloses a common instruction entering level is 
configured to enter at least one related item with respect to a sports game subject to an analysis 
(pitching form of opposing pitcher, col.6, 11.40-49). 

34. Concerning claim 10, Katayama discloses said main instruction entering level is 
configured to select an analysis of data or an analysis of formation regarding a sports game 
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subject to an analysis, as one of said plurality of different kinds of analyses (col.6, 11.12-20, 
especially 11.17-20 (keys Q, R, T)). 

35. Regarding claim 11, Katayama discloses said related item comprising at least one of a 
player, a team, weather, a stadium of a game, a date of a game, a starting time of a game, and a 
number of spectators of a game (player: pitching form of opposing pitcher, col.6, 11.40-49). 

36. Regarding claim 35, Katayama discloses 

• data processing means for generating an image data by image-picking up an image of a 
sports game (through a video camera; col.6, 11.1-3), for processing said image data 
generated in accordance with a predetermined format (video, col.6, 11.1-3); and for storing 
said data processed in said predetermined format (videocassette; col.6, 11.1-3); 

• interface means connected to said data processing means comprising an instruction 
entering means for entering a plurality of instructions (menu screen I, FIG.3, and menu 
screen n, FIG. 11), 

said interface means inputs said processed data in said predetermined format, converts 
said input data into a predetermined form in accordance with an entered instruction, 
(statistics; see, for example, col.6, 11.12-20), 

• and outputs said converted data in accordance with said entered instruction; 
(FIG. 16 — the output of clicking on the score table L icon in FIG.l 1) 

• and image displaying means connected to said interface means for displaying on a screen 
said outputted data from said interface means (monitor display A, FIG.l) 

• wherein said predetermined form comprises at least one of a chart, a numerical list (the 
object labeled "batting order" in FIG.22 is both a chart and a numerical list, and the 
chart/list is produced by the instruction which executes when the R key is pressed (see 
col.8, 11.29-31)), an image (produced by the instruction which executes when the user 
clicks on M and L; col.6, 11.40-44) and a video (the instruction that produces, for 
example, FIG. 12; see also col.4, 11.50-53), 
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• and an instruction entering means which comprises a main instruction entering level for 
performing a plurality of different kinds of analyses (menu screen II, FIG.l 1), 

• wherein said common instruction entering level is configured to enter at least one related 
item with respect to a sports game subject to an analysis (pitching form of opposing 
pitcher, col.6, 11.40-49), 

• wherein said related item comprises at least one of a player, a team, weather, a stadium of 
a game, a date of a game, a starting time of a game, and a number of spectators of a game 
(player: pitching form of opposing pitcher, col.6, 11.40-49), 

• wherein said interface means comprises functions of displaying all plays of an opponent 
teams at said sports game as a list in accordance with said play list, and of retrieving a 
desirable play seen at said sports game by designating an optional item of said play list 
(FIG. 16 displays all plays, and col.6, 11.24-48 explains how a desirable play is retrieved). 

37. However, Katayama does not disclose a common instruction entering level to be utilized 
commonly for said plurality of different kinds of analyses. These elements are disclosed by the 
Tamir sports event video manipulating system (the use of light pen 60 to enter instructions to 
mark objects of interest on a video, col.7, 11.39-52). 

38. Therefore, it would have been obvious to one of ordinary skill in the art to have modified 
the Katayama apparatus in view of the Tamir system by installing the code that enables video 
editing in Tamir in the Katayama personal computer. Such a modification to Katayama would 
enable the user to utilize a fast editing and analysis tool for half-time situations to allow the 
coaches to make strategy adjustment during halftime (Tamir, col.6, 11.18-20). 

39. Accordingly, in view of the foregoing, claims 8-1 1 and 35 are rejected as being 
unpatentable under 35 U.S.C. 103(a) by Katayama and Tamir. 
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40. Claim 34 is rejected under 35 U.S.C. 103(a) as being unpatentable by Katayama in view 
of Jain. 

41. Katayama does not disclose said converted data displayed at an angle selected by a user. 
However, these elements are disclosed by Jain at col. 14, 11.55-58. 

42. Therefore, it would have been obvious to one of ordinary skill in the art to have modified 
the Katayama apparatus in view of the Jain system by installing the Jain scene analysis module in 
FIG.2 between the Katayama video camera J and the Katayama personal computer B (FIG.l). 
Such a modification to Katayama would award the viewer the best view of the object (Jain, 
col.14, 11.59-61). 

43. Accordingly, in view of the foregoing, claim 34 is rejected as being unpatentable under 
35 U.S.C. 103(a) by Katayama and Jain. 

44. Finally, claims 37 and 40 are rejected under 35 U.S.C. 103(a) as being unpatentable by 
Katayama in view of Rosser (U.S. Pat. No. 6,750,919), and further in view of Tamir. 

45. With respect to claim 37, Katayama discloses 

• data processing means for generating an image data by image-picking up an image of a 
sports game (through a video camera; col.6, 11.1-3), for processing said image data 
generated in accordance with a predetermined format (video, col.6, 11.1-3); and for storing 
said data processed in said predetermined format (videocassette; col.6, 11.1-3); 

• interface means connected to said data processing means comprising an instruction 
entering means for entering a plurality of instructions (menu screen I, FIG. 3, and menu 
screen H, FIG.l 1), 
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said interface means inputs said processed data in said predetermined format, converts 
said input data into a predetermined form in accordance with an entered instruction, 
(statistics; see, for example, col.6, 11.12-20), 

• and outputs said converted data in accordance with said entered instruction; 
(FIG. 16 — the output of clicking on the score table L icon in FIG.l 1) 

• and image displaying means connected to said interface means for displaying on a screen 
said outputted data from said interface means (monitor display A, FIG.l) 

• wherein said interface means is operable to convert said inputted data into each of a chart, 
a numerical list (the object labeled "batting order" in FIG.22 is both a chart and a 
numerical list, and the chart/list is produced by the instruction which executes when the R 
key is pressed (see col.8, 11.29-31)), an image (produced by the instruction which executes 
when the user clicks on M and L; col.6, 1140-44) and a video (the instruction that 
produces, for example, FIG. 12; see also col.4, 11.50-53). 

wherein said interface means is configured to enable said image displaying means to 
display a play list or a graph that is indicative of a desired analytical result in response to a kind 
of said instruction (FIG. 16, which concerns meetings between a certain batter and a certain 
pitcher). 

46. However, with respect to both claims, Katayama does not disclose said interface means 
capable of enabling said display means to display simultaneously an animation based on said data 
converted into said predetermined form in accordance with said play list, and an image of a 
sports game based on said image data corresponding to said animation. These elements are 
disclosed by the Rosser method of placing event related information into a video broadcast. The 
interface means is the live video insertion system 16, FIG.l. The display means is 28, FIG.l. 
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The "animation based on said data converted into said predetermined form" is the scoreboard 
(col.7, 11.58-59). It is played in accordance with said play list (Katayama, FIG. 16 and col.6, 11.40- 
61), and an image of a sports game based on said image data corresponding to said animation is 
disclosed in both Katayama, FIG. 12, and Rosser col.5, 1.25. 

47. Therefore, it would have been obvious to one of ordinary skill in the art to have modified 
the Katayama apparatus in view of the Rosser system by installing the software in the Rosser live 
video insertion system unit 16, FIG.l (see Rosser, col.4, 11.10-14) into the Katayama personal 
computer B (FIG. 1). Such a modification to Katayama would allow addition of event related 
information into a video so that the added information does not interfere with or obscure the 
primary action of interest in the video (Rosser, Abstract, first sentence). 

48. Neither Katayama nor Rosser disclose editing a video of said sports game while analyzing 
data of said sports game. These elements are disclosed by Tamir (the use of light pen 60 to enter 
instructions to mark objects of interest on a video, col.7, 11.39-52). 

49. Therefore, it would have been obvious to one of ordinary skill in the art to have modified 
the Katayama apparatus in view of the Tamir system by installing the code that enables video 
editing in Tamir in the Katayama personal computer. Such a modification to Katayama would 
enable the user to utilize a fast editing and analysis tool for half-time situations to allow the 
coaches to make strategy adjustment during halftime (Tamir, col.6, 11.18-20). 
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50. Accordingly, in view of the foregoing, claims 37 and 40 are rejected as being 
unpatentable under 35 U.S.C. 103(a) by Katayama, Rosser and Tamir. 

Response to Remarks 

5 1 . The examiner appreciates the applicant's efforts to make this application allowable. 
However, new art has been found that discloses the "main instruction entering level" (Katayama) 
and "common instruction entering level" (Tamir) of claims 8 and 22, "interface means operable 
to convert said inputted data into each of a chart, a numerical list, an image and a video" 
(Katayama), a data list (Katayama), and the four instructions of claim 20. In addition to these 
claim limitations, the examiner has found art for many other claim limitations previously deemed 
to be allowable. Therefore, this rejection is non-final. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the Office 
should be directed to the examiner, Lance Sealey, whose telephone number is (703) 305-0026. 
He can be reached from 7:00 am-3:30 pm Monday-Friday EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mark Zimmerman, can be reached at (703) 305-9798. 

Any response to this action should be mailed to: 

MS Non-Fee Amendment 
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Art Unit: 2671 



Commissioner for Patents 



P.O. Box 1450 



Alexandria, VA 22313-1450 



or faxed to: 

(703) 872-9306 

Hand-delivered responses should be brought to Crystal Park n, 2121 Crystal Drive, 
Arlington, VA, Sixth Floor (Receptionist). 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 




MARW^ZIMMERMAN 
SUPERVISORY PATENT EXAMINER 
TECHNOLOGY CENTER 2600 



